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1.  Objectives 

A  recent  strand  of  research  in  optimization  methods  has  been  inspired  by  collective  forms  of 
intelligence  present  in  many  biological  systems  (e.g.  swarming,  flocking).  In  these  systems, 
a  great  deal  of  coordination  is  achieved  under  relatively  minimal  communication  require¬ 
ments.  In  this  research  project  we  have  developed  new  methods  for  global  optimization  and 
distributed  search  that  are  inspired  by  certain  biological  systems. 

2.  Results 

2. a  In  [1]  and  [2],  we  developed  a  distributed  algorithm  based  upon  the  notion  of  stigmergy. 
By  disseminating  a  scent,  searching  agents  could  avoid  inefficient  duplication  of  search 
efforts.  This  scheme  was  shown  to  work  well  in  scenarios  in  which  searching  agents  are 
homogeneous  (i.e.  they  are  equipped  with  the  same  sensor  technology). 

2.b  In  [3]  we  have  considered  improvements  to  the  cross-entropy  (CE)  method  which  are 
also  inspired  by  stigmergy  (see  2. a).  In  the  CE  method,  a  sampling  distribution  within 
a  given  class  is  selected  at  each  iteration.  The  selected  sampling  distribution  minimizes 
the  Kullback-Leibler  divergence  with  respect  to  a  reference  distribution.  This  reference 
distribution  is  meant  to  reflect  the  quality  of  solutions  found  so  far  and  is  updated  after 
every  iteration.  For  the  CE  method,  convergence  to  global  optima  almost  surely  (or 
with  probability  1)  can  be  established  under  certain  conditions.  A  Markov  chain  model 
(where  the  state  space  is  an  index  set  of  the  class  of  sampling  distributions)  can  be  used 
to  analyze  the  CE  method.  We  have  shown  that  the  speed  of  convergence  (dictated  by 
the  second  largest  eigenvalue)  is  directly  related  to  the  “worst”  possible  state.  In  other 
words,  there  is  a  state  (i.e.,  a  sampling  distribution)  in  which  the  process  remains  for  a 
relatively  large  number  of  iterations.  Using  a  repulsive  potential  for  several  interacting 
processes,  we  have  shown  that  the  magnitude  of  the  second  largest  eigenvalue  can  be 
effectively  reduced  thus  speeding  up  convergence  to  global  optima. 

2.c  In  [5],  we  present  a  novel  approach  in  which  parallel  annealing  processes  interact  in  a 
manner  that  expedites  the  identification  of  a  globally  optimal  solution.  A  first  anneal¬ 
ing  process  operates  at  a  faster  time  scale  and  has  a  drift  function  that  converges  to 
a  non-zero  (but  relatively  small)  noise  level.  A  second  annealing  (operating  a  slower 
time  scale)  is  subject  to  a  modified  drift  term  in  which  the  steepest  descent  direction  is 
perturbed  with  the  first  process’s  density  gradient.  This  additional  term  ensures  that 
the  second  annealing  process  is  “repelled”  by  the  proximity  of  the  first  process.  As  a 
result,  the  first  annealing  process  (which  quickly  identifies  locally  optimal  solutions) 
allows  the  second  annealing  process  to  bypass  locally  optimal  solutions  recently  iden¬ 
tified  so  that  its  own  “cooling  schedule”  can  be  made  to  converge  to  zero  at  a  faster 
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rate.  We  show  that  when  compared  to  independent  annealing  processes,  the  proposed 
scheme  can  increase  the  speed  of  convergence  and/or  the  quality  of  solutions  identified 
in  finite  time  at  the  expense  of  minimal  additional  computational  overhead. 

2.d  The  notion  of  interacting  annealing  processes  motivated  a  new  application  in  the  con¬ 
text  of  congestion  games.  In  [4],  we  develop  a  pricing  scheme  for  controlling  annealing 
process  that  interact  through  a  congestion  externality. 

3.  Accomplishments/New  Findings 

The  papers  summarized  above  deliver  on  the  research  tasks  originally  proposed  in  this 

project. 
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